"The highlighted tokens are primarily Vietnamese words and morphemes that serve as key content carriers, including nouns, verbs, adjectives, and numerals, as well as grammatical markers and affixes. These tokens often appear at the start or end of words, or as standalone function words, and are crucial for conveying the main meaning, structure, or relationships within sentences. The activations tend to focus on semantically significant elements, such as entities, actions, quantities, and modifiers, reflecting their importance in sentence comprehension and information extraction."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.78 | 1.0 | 0.56 | 0.718 | 0.56 | 1.0 | 0.0 | 0.44 |
fuzz | 0.81 | 1.0 | 0.62 | 0.765 | 0.62 | 1.0 | 0.0 | 0.38 |